ON INTEGRABILITY OF QUADRATIC HARNESSES 



WLODEK BRYC 



Abstract. We investigate integrability properties of processes with linear re- 
gressions and quadratic conditional variances. We establish the right order of 
dependence of which moments are finite on the parameter err defined below, 
raising the question of determining the optimal constant. 



1. Introduction and main results 

The study of processes with linear regression and quadratic conditional vari- 
ances was initiated by Plucihska |Plucihska (1983)] who gave a characterization of 
the Wiener process in terms of conditional means and conditional variances. This 
approach was extended by several authors in many directions, sometimes with a 
trade-off between the amount of conditioning assumed and how much information 
is available about the covariance. Of the early generalizations, we mention here 



the work of Szablowski |Szablowski(1989) who extracts information from minimal 



assumptions on conditioning, provided that the covariance is smooth. In his influen- 
tial work Wesolowski |Wesolowski (1993)] characterized processes whose conditional 
variances is an arbitrary quadratic polynomial in the increments of the process; 
besides the Wiener process, such processes turned out to be either the Poisson pro- 
cess, or the negative binomial process, or the gamma process, or the hyperbolic 
secant process. 

Processes with conditional variances given by more general quadratic polynomi- 
als have been analyzed in a series of papers th at started with |Bryc(2001)|, and 
culminated with Askey- Wilson polynomials in Bryc and Wesolowski(2010)] . In 



these papers, the authors used algebraic techniques to study associated orthogo- 
nal polynomials, and to identify and construct a number of more exotic Markov 
processes with linear regressions and quadratic conditional variances. 

The technique of orthogonal polynomials relies on apriori information about the 
existence of moments of all orders. Integrability can be deduced from assumptions 
on conditional variances, see [Bryc and Plucih ska(1985) , Wcsolowski(1993) , and 



more recently Bryc et al.(2007)| Theorem 2.5], Unfortunately, available integra- 



bility results do not cover all possible quadratic conditional variances, and in fact 
they do not use the full power of the " quadratic harness condition" (|3.ip and (13. 2[) 
at all. Instead, they are based on the following weaker assumptions which appeared 



Bryc et al.(2007) (2.7),(2.8)(2.27), (2.28)]: 



(1.1) E(X t ) = Q,E(X t ,X s ) = mm{s,t} 



Date: File: moments-201fv2.tex Printed October 7, 2011. 
2000 Mathematics Subject Classification. 60E15 . 

Key words and phrases, integrability, polynomial regression, quadratic harnesses. 

1 



2 



WLODEK BRYC 



For s < t, the one-sided conditional moments satisfy: 

(1.2) E(X t \X s ) = X s , E(X s \X t ) = S -X t , 
and there are constants i], 9 £ R and cr, r 6 [0, oo) such that 

(1.3) Var(X t |X s ) < (l + ? /X s + aX 2 s ) , 

(1.4) Var(X s |X t ) < ^— ^ (l + 0X t /t + rX t 2 /t 2 ) . 

Our goal is to show that these expressions imply finiteness of moments of order 



l/i/ar, improving a bound in Bryc et al.(2007) Theorem 2.5] who prove finiteness 



of moments of a logarithmic order — log(crr) . 

Theorem 1.1. If(X t )t<o is o, square-integrable process such that (11.11) . (11.21) . (11.31) . 

and (|1.4[) hold for all s < t < u with some o~t > , then ~E(\X t \ p ) < oo for all 

Remark 1.2. From Jamiolkowska(2009)| it follows that for any a — r > moments 
of order 2+^= may fail to exist. For comparison, Theorem l 1 . 1 l implies integrability 

oforderp<l +i ^. (Indeed, l + j^ = \ (2 + < max {2, }■) 

Remark 1.3. Of course, if o~t = then moments of any order p > are finite. Since 



this is already known from Bryc et al.(2007) Theorem 2.5], here we concentrate 
on the case ot > 0. 

2. Proof 



The proof is based on tail estimates introduced in Bryc and Plucinska(1985)] ; 



the main improvement over [Bryc et al.(2007) Theorem 2.5] comes from a more 



careful choice of random variables X-y/ u ,X u with u close to 1. Such a choice was 
suggested by |Szablowski(1986)| Theorem 2]. 

We shall deduce Theorem ll.il from the following result. 



Proposition 2.1. Under the assumptions of Theorem \l.l[ if 2 < p + 1 < 240 ^/ CT7 . 
and E(\Xt\ p ) < 00 for all t, then there exists to > such that E(\Xt \ p+1 ) < 00. 

We first show how Theorem 11.11 follows . and then we will prove Proposition 12. II 

Proof of Theorem It suffices to show that the moment of order p = 2 4Q^/ CTr 
exists. Without loss of generality we may assume that po > 2, that is we consider 
only err small enough. 



We apply Proposition 12 . 1 1 recursively. Define pk — Po ~ k, k — 0, 1, . . . , K , where 
K = min {k : po - k < 2}. Then K > 1 so 2 < p K + 1 < p Q < 2iQ ]^ and h ? 
square-integrability of the process, E(|X t | Pfc ) < 00 for all t. So by Proposition ^. II 
there exists to > such that E(|JQ 1^- 1 ) < 00. However, (|1.2[) then implies that 
Ed^tl^'^ 1 ) < 00 for all t. If K = 1, the recursion ends; otherwise, if K > 2, 
the recursion can be continued: by Proposition 12. 1| there exists to > such that 
E{\X to \ PK - 2 ) < 00, and so on. The recursion ends with E(\X t \ Pl+1 ) = E(\X t \ Po ) < 
00. □ 
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2.1. Proof of Proposition I2TT1 We first consider a pair of square-integrable ran- 
dom variables X, Y such that 

(2.1) E({X-pY) 2 \Y) < A + B\Y\ + {\- p) P 5Y 2 

(2.2) E((Y - pX) 2 \X) < A + B\X\ + (1 - p)p8X 2 

for some constants A, B > 0. For small enough S we have the following tail estimate. 

Lemma 2.2. Suppose X,Y are square-integrable and satisfy (|2.1j) and (|2.2j) with 
some 1/2 < p < 1, and 6 < (1 - p)/64. Denoie iV(t) = Pr(|X| > i) + Pr(|F| > t) 
and let K = 2/ p — 1. TTien £/iere are constants C\, C 2 such that for t > 0, 

(2.3) N(Kt)<^ + ^ + ^)N(t). 

Proof. Throughout the proof, C\ , C 2 denote generic positive constants that may 
change from line to line. As in the proof of Bryc et al.(2007) Theorem 2.5], we 
write 

(2.4) N(Kt) < 2P x (t) + P 2 (t) + P 3 (t), 

where Pi(i) = Pr(|X| > t,\Y\ > t), P 2 {t) = Pi{\X\ > Kt,\Y\ < t), P 3 (t) = 
Pr(|X| < t, \Y\ > Kt). Next we observe that 

Pi(i) < Pr [\X - pY\ > ^^-^Y 2 +t 2 , \Y\ > t 

+ Pr (|Y - P X\ > tL_Pl^/ X 2 + t2, \X\ > t 
By (|2.1|) . conditional Chebyschev's inequality gives 

Pr (\X - P Y\ > V-^t-^Y2+t 2 , \Y\ > tj 

<2 f A + B\Y\ + (l-p) P SY 2 
~ J\Y\>t (l-p) 2 (Y 2 +ti) 

(A B 28 \ „ , 

(Here we also used a trivial bound p < 1.) Since a similar bound follows from (|2.2|) . 
we get 

72" + T + T - P/ 

Next, we use the trivial bound \Y — pX\ > p\X\ — \Y\ to estimate 



(2.5) P 1 (t)< ( -± + -± + —-) N (t), 



P 2 (t) < Pr(\X\ > Kt, \Y - P X\ > p\X\ - t) 
< Pr 



(\X\ > Kt, \Y - P X\ > y/2Sp(l - p)\X\ + (p- y/2Sp(l - p))\X\ - t) 
< Pr (\X\ > Kt, \Y - pX\ > y/26p(l-p)\X\ + (K(p - ^2Sp{l - pj) - l)t 



In the last bound, we already used the inequality p — y / 25p(l — p) > 0, which we 
now further improve. Since p > 1/2 and S < (1 — p)/64, we get 2pS < p(l — p)/2 5 < 
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p 4 (l - p)/(2 - pf, and 

K(p-^2Sp(l-p)) > K(p-(l-p)p 2 /(2-p)) = (2-p) (l - = 1+(1-P) 2 

Therefore, 

P 2 (t) < Pr (|X| > Kt, \Y - pX| > y/2Sp(l-p)\X\ + (1 - p) 2 i) , 
and from (|2.2p we get 

Pa(f) < /■ A + ^l + d-p)^ 

" 7ixi>jsrt U/25p(l-p)\X\ + (1 - p)^) 2 



Thus 



and with similar bound applied to Ps{t) we get 



(2.6) P 2 (t) + P 3 (t) < ( ^ + -i- ) iV(i) + -N(Kt). 



Combining (j2H) with (1231) and (ETo) we get 

, , fCt C 2 45 \ , , 1 , , 
AW < ( ^ + + —J tf(t) + ^N(Kt). 

Thus ((231) follows. □ 
Next, we prove the integrability lemma. 

Lemma 2.3. Fix p > 1 and a pair of square- integrable random variables X,Y 
such that E\X\p + E\Y\p < oo. Suppose X,Y satisfy dUT]) and §T2§ with p 
1 - 1/0 + 1) < 1, and 1205(p+l) < 1. Then E|X| P+1 + E|Y < oo. 

Proof. Using the notation of Lemma l2~2| we want to show that if Mi = J °° t p ~ 2 N(t)dt < 
oo and M 2 = / °° f^N^dt < oo then 

(2.7) sup / t p N(t)dt < oo. 



M>0 Jo 

Note that since p > I, Mi < oo is equivalent to integrability of |X| p ^ 1 + |y| p ~ 1 . The 
latter follows by Holder inequality from the assumed integrability of \X\ P + |Y| P . 

Since p > 1 implies that 1/2 < p < 1 and by assumption we have 64<5(1 — p) = 
64<5(p + 1) < 1, from Lemma T2.2I we see that (|2.3[) holds. By a change of variable 
from (|2.3|) we get 



P Af /-M /A' 

(2.8) / t p N{t)dt = K p+1 / t p N{Kt)dt 



pM/K p M/K 

< dK p+1 / t p - 2 N(t)dt + C 2 K P+1 / tP^N^dt 
Jo Jo 

* d Jl / t PN(t)dt < dKP+Hh + C 2 KP +1 M 2 + — / 

1-P io 1 - P Jo 



t p N(t)dt. 
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By our choice of p = l-l/(p + l), we have (1 - l/(p+ > (l-l/(p + l))l/e > 
l/(2e), so 

Thus s^ p+1 < 16e 2 <5(p + 1) < 120% + 1) < 1, and jUJ implies that (g^J) 

holds. ' □ 

Proof of Proposition ^ ft Given p > 1, choose p = 1 — l/(p+l). Notethatp> 1/2. 
Take 

„ _ pVt t _ Vt 



Then from (TTT]) we get E(XY) = p. From (TQ|) and (fl~4| we get 

1 -P 2 (, , „ ^/» v , . 



E((x- P y) 2 |r) < __|=-^i + ^-r + p ^ 2 j, 
E((r- P x) 2 |x) < - l ~jL (i + T}y /p'fLx+ pyf^x- 



1 + \J~oTp \ \ a 

So inequalities (|2.1j) and (|2.2p hold with 5 = for some constants A, £? > 0. 



The result follows from Lemma \2. 31 □ 

3. INTEGRABILITY CONJECTURE 

Let S > 0. Recall that (X t ) te ^ is a quadratic harness on a non-empty open 
interval T with parameters (rj, 9, a, r, 7) if it satisfies (jl.ll) . (|1.2[) for all s < t in T, 
and in addition that (jl.3p and (|1.4j) hold with equality, and that for all s < t < u 
in T, 

(3.1) E(X t \X s ,X u ) = ^±X S + t —^X t 

u — s u — s 

and 



(3.2) Var(X t |X s ,X u )=F M>u (l 



X u — X s uX s — sX u 

■v- 



u — s u — s 

2 („, Y _ a V \2 



(X u -X s ) 2 t (uX s -sX u ) 2 . (uX s - sX u )(X u - X s ) 



- (1- 7) 7 T2 )> 

«-sr / 



(u — s) 2 (u — s) 2 (u — s) 2 

where 

u(l + so") + r — S7 

Theorem 11.11 docs not use (|3.ip , p. 21) , so it does not use the all properties of a 
quadratic harness. 

Conjecture 3.1. Suppose that (X t ) is a quadratic harness on (1 — 5, 1 + S) for 
some 6 > 0. 

(i) If < ctt < 1 and I- 2^/^? < 7 < 1 + 2^F, *Aen E(|X t |P) < 00 /or aZZ 
0<p<2 + ^. 

(ii) If ot is small enough and — 1 < 7 < 1 — 2\far, then E(|Xt| p ) < 00 for all 
p>0. 
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By Theorem ll.il Conjecture [3J] is true for err — 0, and this result has essentially 
been known, although it was stated only for quadratic harnesses on (0,oo). An 
even stronger version of Conjecture 13 . 1 f ii) . formulated by J. Wesolowski, says that 
if— 1 <7< 1 — 2y/ar and err is small enough then X t is bounded. Here we indicate 
that this stronger version of Conjecture I3.1f ii) holds true for 7 = — 1 . 

Proposition 3.2. Suppose that (Xt) is a quadratic harness on (1 — 5,1 + S) for 

some S > 0, with parameters 7 = —1 and or < 1/921600 rs 10~ 6 . Then for every 
t G (1 — 5, 1 + 5), random variable X t has (at most) two values. 



Sketch of proof . Since err < 1/921600, from Theorem ll.il we deduce that the 4-th 
moments exist. From a longer calculation based on the arguments in the proof 



of Bryc et al.(2007) Lemma 3.5], one can obtain the formulas for the first four 



moments, and compute the Hankel determinant 
det 



1 t 

t E(X t 3 ) 

t E(At) nxt) 



(t + r)(l + to) ((r)T + 0)(v + Oa) + (1 - <tt) 2 ) 
1 - (2 + 7)<rr 



Since 7 = — 1, the Hankel determinant is zero, and the distribution is concentrated 
on two points. □ 
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